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Abstract 

We consider QCD axion models where the Peccei-Quinn symmetry is badly bro¬ 
ken by a larger amount in the past than in the present, in order to avoid the axion 
isocurvature problem. Specifically we study supersymmetric axion models where the 
Peccei-Quinn symmetry is dynamically broken by either hidden gauge interactions or 
the SU{3)c strong interactions whose dynamical scales are temporarily enhanced by 
the dynamics of flat directions. The former scenario predicts a large amount of self¬ 
interacting dark radiation as the hidden gauge symmetry is weakly coupled in the 
present Universe. We also show that the observed amount of baryon asymmetry can 
be generated by the QCD axion dynamics via spontaneous baryogenesis. We briefly 
comment on the case in which the PQ symmetry is broken by a non-minimal coupling 
to gravity. 



1 Introduction 


The strong CP phase is constrained to be less than 10“^° by the nentron EDM experi¬ 
ments [1], and the problem of why it is so small is known as the strong CP problem. One of 
the solntions is the Peccei-Qninn (PQ) mechanism [2, 3], which renders the strong CP phase 
a dynamical variable, an axion, which arises as a psendo Nambu-Goldstone (NG) boson in 
association with the spontaneons breakdown of the global PQ symmetry [4], The axion 
acqnires a mass throngh nonperturvative effects of QCD [5, 6] and its vacnum expectation 
valne (VEV) cancels the nndesired CP phase. The dynamical relaxation necessarily indnces 
coherent oscillations of the axion, which can acconnt for dark matter in the Universe [7, 8, 9]. 

The PQ symmetry must be of extremely high quality to solve the strong CP problem, as 
even a tiny breaking would results in a too large CP phase in contradiction with the exper¬ 
iments [10, 11, 12, 13, 14, 15, 16]. The high quality of the PQ symmetry could be due to a 
non-trivial discrete symmetry of high order Zn [17] or a higher dimensional gauge symmetry 
(or its combination with an anomalous U(1 )a symmetry) [18].^ Here we would like to empha¬ 
size that, from a purely phenomenological point of view, the PQ symmetry could be badly 
broken by a larger amount in the early Universe, as long as the extra breaking disappears 
in the present Universe. Interestingly, in the presence of such a large PQ breaking in the 
early Universe, the axion becomes so heavy that its quantum fluctuations are suppressed, 
avoiding tight constraints on the axion isocurvature perturbations [24, 25, 26, 27, 28].^ 

In this paper we study a possibility that the PQ symmetry is largely broken temporarily in 
the early Universe, and discuss their cosmological implications based on a couple of models. 
Specifically we first discuss supersymmetric axion models in which the PQ symmetry is 
largely broken by non-Abelian hidden gauge interactions which are strongly coupled during 
inflation. If the axion acquires a sufficiently heavy mass, its quantum fluctuations would be 
suppressed. In the present Universe, on the other hand, the hidden gauge interactions must 
be weakly coupled, which is made possible by a dynamics of flat directions in the hidden 
sector. We shall also see that the axion dynamics after inflation can generate a sizable 
baryon asymmetry a la spontaneous baryogenesis [40, 41, 42, 43, 44]. We also show that the 
suppression can be realized in a more economical model where the PQ symmetry is broken 
only by the SU{3)c strong interactions. The QCD scale can be enhanced if the HuHd flat 
direction acquires a large VEV in the early Universe [29, 25]. 

The rest of the paper is organized as follows. In Sec. 2, we briefly review observational 

^ See Refs. [19, 20, 21, 22, 23] for other models of the origin of the PQ symmetry. 

^ The stronger QCD was proposed to suppress the axion abundance [29]. See also Ref. [30, 31]. There 
are various ways to suppress the axion isocurvature perturbations [32, 33, 34, 35, 36, 37, 38, 23, 39]. 
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constraints on the axion isocnrvatnre pertnrbations. In Sec. 3, we provide snpersymmetric 
axion models where the dynamical scales of the hidden or SU{3)c gange interactions are 
enhanced dnring and some time after inflation, dne to the dynamics of a flat direction. After 
inflation ends, the axion dynamics generates baryon asymmetry via spontaneons baryogene- 
sis. We also show that the scenario can be natnrally realized when the scalar held is identihed 
with the HuHd hat direction. The last section is devoted to conclnsions. In Appendix we 
briehy discnss the case in which the PQ symmetry is broken by an interaction between the 
axion and the Ricci scalar. 


2 Axion isocurvature problem 


The axion is a psendo NG boson associated with the spontaneons breakdown of the PQ sym¬ 
metry, which is assnmed to be anomalons nnder QCD [4]. Snppose that the PQ symmetry 
is spontaneonsly broken at an intermediate scale Va- Then, the axion acqnires a non-zero 
mass throngh non-pertnrbative ehects of the QCD instantons as [5, 6] 


rua ~ 


m^rrid 

{mu + mdf fa 


( 1 ) 


where fa (= Wa/A^Dw) is the axion decay constant and Vdw is the domain wall nnmber. 
Here, f^, is the pion decay constant, and m^, and are the masses of np qnark, down 
qnark, and pion, respectively. 

The axion stays almost massless at high temperatnres, and its mass gradnally grows 
as the temperatnre T decreases down to the QCD scale Aqcd- In a thermal plasma with 
temperatnre T 3> Aqcd, the axion mass is given by [45, 46] 

m;(r)~1.68xl0-’^(^) , (2) 

fa V^QCD/ 

where n ~ 6.68. When the axion mass becomes comparable to the Hnbble parameter, it 
starts to oscillate abont the CP conserving minimnm. The energy density of the axion 
oscillations decreases in proportion to a“^, where a is the scale factor, and hence it is a good 
candidate for cold dark matter (CDM). Neglecting the anharmonic effect [47, 48], the axion 
abnndance is given by [49] 


~ 0.011 l^ini 


fa 


1011 GeV 


1.19 


/ Aqcd a 
V400 MeV J ’ 


( 3 ) 


where h is the Hnbble parameter in nnits of 100 km/s/Mpc and Oiai is the initial misalignment 
angle. Barring hne-tnned cancellations, 6*ini is considered to be of order nnity. The observed 
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DM abundance Vt-^yih? ~ 0.12 can be explained if the axion decay constant is given by 


/, ~ 7.4 X 10^' GeV x 


( 4 ) 


where we have substituted Aqcd = 400 MeV. 

If the axion mass is smaller than the Hubble parameter during inflation, it acquires 
quantum fluctuations as 





gjnf 

2vr/a’ 


( 5 ) 


where Hi^f is the Hubble parameter during inflation. This results in the axion CDM isocur¬ 
vature perturbations through the dependence of Da on 9ini (see Eq. (3)), 


hDa S9ini 

5a., = ~ 2 — , 


( 6 ) 


where |(f6*ini/6'ini| 1 is assumed. 

The cosmological data can be explained by purely adiabatic density perturbations, and 
only a small admixture of isocurvature perturbations is allowed. In fact, the Planck Col¬ 
laboration derived a tight upper bound on the fraction of the uncorrelated isocurvature 
perturbation as [50] 


'Pssjk^) _ 

'Pnnik^) + 'Pssik^) 


< 0.038 (95% C.L.), 


( 7 ) 


where Vnn and Vss are the power spectra of the adiabatic and isocurvature perturbations, 
respectively, and /c* (= 0.05 Mpc“^) is the pivot scale. Thus we obtain an upper bound on 
the axion isocurvature perturbations as 


|5a,|< 9.1x10-®, (8) 

where we have used Vtih — 2.2 x 10“® [50]. Therefore, the axion isocurvature perturbations 
tightly constrain the energy scale of inflation as 

0.405 

(9) 

The constraint becomes even severer when the anharmonic effect is relevant around ^ini — 
TT [47, 48]. The upper bound is inconsistent with high or intermediate scale inflation mod¬ 
els, such as the i?^-inflation model [51], chaotic inflation model [52], and hybrid inflation 
model [53]. In particular, if the primordial B-mode polarization is detected by the future 


7/inf < 0.94 X 10^ GeV 


fa 


IQii GeV 
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CMB polarization experiment, it would be in a strong tension with the axion CDM sce¬ 
nario [26, 54, 55], 

There is one caveat in the above analysis: the axion is assumed to be massless during 
inflation. In the rest of this paper, we study axion models with a larger breaking of the PQ 
symmetry during inflation in order to avoid the constraint of Eq. (9). 


3 QCD axion models with dynamically broken PQ sym¬ 
metry 

Now we introduce supersymmetric axion models in which the PQ symmetry is broken by a 
larger amount in the early Universe either by hidden gauge interactions or by the SU{3)c 
strong interactions. We first consider the former case in the following, and we will show 
that the axion isocurvature perturbations can indeed be suppressed. Then we investigate 
the dynamics of the axion after inflation and show that a right amount of baryon asymmetry 
can be generated by spontaneous baryogenesis. In Sec. 3.4, we estimate the amount of axion 
DM and self-interacting dark radiation made of weakly-coupled hidden gauge fields. Finally, 
we introduce a more economical model where the PQ symmetry is broken by the stronger 
QCD and a hidden flat direction is replaced by the HuHd flat direction. 

3.1 PQ symmetry breaking by hidden gauge interactions 

Let us consider a model in which the PQ symmetry is dynamically broken by hidden SU{N)h 
gauge interactions in the early Universe. We introduce a PQ breaking scalar held "0, a 
singlet scalar held 0, and Npi^Np) hidden quarks and anti-quarks Qh^Qh {Q'h^Q'h) 
fundamental and anti-fundamental representation of SU{N)h, with (without) PQ charges. 
The charge assignment is shown in Table 1.^ For simplicity, we assume that the fields Qh and 
Qh are also charged under SU{3)c in the fundamental and anti-fundamental representation, 
respectively so that they play a role of the heavy PQ quarks to induce the color anomaly 
term for the axion [56].“^ 

^ In general, the high quality of the PQ symmetry is a puzzle because global symmetries are considered 
to be broken in nature [10, 11, 12, 13, 14, 15, 16]. This puzzle is neither worsened or improved compared 
with the ordinary field-theoretic QCD axion models, because the extra PQ breaking effects we introduced 
disappear in the present vacuum. The required PQ breaking scale in our model is of order 10^^ GeV. This 
implies that Zjv symmetry with TV > 17 is necessary to suppress Planck-suppressed PQ breaking operators, 
if we are to explain the lightness of the QCD axion by a single discrete symmetry [17]. There are also some 
other mechanisms to explain the origin of the PQ symmetry (see Refs. [18, 19, 20, 21, 22, 23]). 

“^Instead, one may introduce heavy PQ quarks separately, if Qh and Qh are singlet under SU{3)c- 
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ip 

Qh 

Qh 

P 

Qh 

Q'h 

SU{3), 

1 

3 

3* 

1 

1 

1 

SU{N)n 

1 

N 

N* 

1 

N 

N* 

C(1)PQ 

1 

-1/2 

-1/2 

0 

0 

0 


Table 1: Charge assignment for matter chiral snperhelds. 

We consider the snperpotential of 

w = y^j ij Q^hQh + y'ki^QnQ'H + ^PQ + (10) 

where i, j, k, and I are flavor indices and we omit SU{N)h and SU{3)c indices which are 
contracted in a gange invariant way.^ The snperpotential of WpQ represents interaction 
terms for -0 to develop a nonzero VEV which spontaneonsly breaks the PQ symmetry. We 
assnme that the axion decay constant (the PQ breaking scale) remains constant thronghont 
the history of the Universe. While we have introdnced only a single PQ held ip for simplicity, 
we may introdnce another PQ scalar ip to write down a snperpotential like WpQ D nS^ipip — 
v‘^/4), where k is a parameter and S' is a singlet chiral snperheld. Assnming an (approximate) 
exchange symmetry between ip and ip, they are stabilized at = \ip\ = Va/2. The axion 
is given by a combination of the phases of ip and ip. As long as the inhation scale is lower 
than Va, the PQ breaking scale remains almost constant in this case. 

Let us hrst focus on the axion in the present Universe, assuming that the hidden SU{N)h 
is weakly coupled and (p is stabilized at the origin (or its VEV is sufficiently small). For 
instance, in the non-SUSY limit where the SUSY particles are integrated out, the hidden 
SU{N)h is asymptotic non-free if Vj. > llV/4. Then, the phase of ip (or a combination 
of the phases of ip and ip in the above example) becomes the axion, and its anomalous 
coupling to gluon helds is induced by the diagram with Qh and Qh running in the loop. 
The domain wall number is equal to NNp in this model. The axion is stabilized at the 
CP conserving minimum, solving the strong CP problem. Note that the PQ symmetry is 
anomalous under SU{N)h, which however does not affect the axion mass as long as SU{N)h 
is weakly coupled. 

The situation is different and more complicated if p develops a large VEV in the early 
Universe. Before going into details, let us briefly outline a rough sketch of our scenario. 

® In Ref. [57], they investigated a similar non-SUSY model. They have considered a scenario that the 
PQ symmetry is largely broken after inflation due to the strong dynamics of hidden gauge interaction. They 
assume Np = ^ so that domain walls decay soon after the phase transition of the hidden gauge symmetry. 
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First, as we shall see below, the 17(1 )_r symmetry is spontaneously broken by a non-zero 
VEV of 0, and the phase component (j) becomes a pseudo NG boson called the i?-axion.® 
The U{l)ji symmetry is not an exact symmetry of nature, and it is explicitly broken by a 
constant term in the superpotential, W D Wq = m 3 / 2 Tfp[, where m^i 2 is the gravitino mass. 
It is possible that the inflaton sector also does not respect the G(l)/j symmetry, in which 
case the i?-axion can be so heavy that it does not acquire sizable quantum fluctuations at 
superhorizon scales. In general, the R-axion mass is given by [58] 


= 


8 W 


PrM. 


\F4i - ShFl, 


where the R-axion coupling is given by 


( 11 ) 


Jr = V2Ri(t)i, 


( 12 ) 


where Ri is the R charge of held (pi and (pi represents a held which spontaneously breaks 
the U{1)r symmetry. We assume that the U{1)r symmetry is explicitly broken in the 
inhaton sector so that the R-axion mass is comparable to (or heavier than) the Hubble 
parameter during inhation. This is the case if ~ \Fp ~ |hF|^/0^. In other words, the 
mass of the phase component of (p is of order the Hubble parameter due to the Hubble- 
induced H-term. Secondly, the hidden quarks Q'r and acquire a heavy mass through 
its coupling to (p, and they are decoupled from the low-energy physics. As a result, the 
running of the gauge coupling gn of SU{N)h is modihed, so that it becomes conhned during 
inflation if the conhnement scale is higher than if inf. This implies that the PQ symmetry is 
broken badly by non-perturbative effects of SU{N)h- Thus, the axion mass receives an extra 
contribution during inflation, suppressing the quantum fluctuations. The axion dynamics 
just after inflation is involved as we shall study in detail later in this section. Some time 
after inflation the potential minimum of (p shifts to the origin, and the SU{N)h becomes 
weakly coupled. The axion becomes almost massless and it remains so until the QCD phase 
transition. 

Now let us discuss the dynamics of (/> in a greater detail. We assume that 0 is a flat 
direction, namely, the potential of (p is flat in the SUSY limit at the renormalizable level, 
which can be ensured by assigning a certain R charge or a discrete symmetry. Such flat 
directions can be lifted by soft SUSY breaking terms as well as non-renormalizable terms. 
To be concrete we consider the following superpotential for (p\ 


W^{(P) = A 


4Mpi’ 


(13) 


® Depending on the R charge of ip, the it-axion may be composed of a combination of the phases of p 
and Ip. This however does not change our arguments. 
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where we assign i?-charges as R{4>) = 1/2 and R{Q'uQ'fj) = 3/2, and Mpi ~ 2.4 x 10^® GeV 
is the reduced Planck mass. During inflation, the potential of (j) is given by 

(</>) = ml 101^ - ChH'^ 101^ - + c-c-^ + 

where is the soft SUSY breaking mass of (j) and the second term in the RHS is the 
Hubble-induced mass term [59]. The term in the parenthesis is the Hubble-induced A- 
terms, which generically arises when the inflaton breaks the U(1 )k symmetry. Hereafter, we 
set ch = an = ^ for simplicity. 

During inflation, since the flat direction has a mass of order the Hubble parameter, the 
(j) is stabilized at its potential minimum: 




V y3A 


1/2 


(15) 


The phase direction of 0 also obtains a mass of order the Hubble parameter due to the 
Hubble-induced H-terms. Therefore, it stays at 0 = 0 and it does not acquire any sizable 
quantum fluctuations at large scales. 

After inflation ends, the inflaton (not 0) starts to oscillate around the potential minimum 
and the energy density of the Universe is dominated by the inflaton oscillation. During the 
inflaton oscillation dominated era, there is a dilute plasma with temperature. 


T ~ 


/ 36if(t)rjMgi y/^ 

V 9*{T)7r^ ) 


oc a 


- 3/8 


( 16 ) 


where ff(t) = 2/(3t), and T/ is the inflaton decay rate. Note that, if the plasma temperature 
is higher than ~ //Va, the hidden SU{N)h gauge fields as well as the hidden quarks are 
thermalized because Qh and Qh are charged under both SU{3)c and SU{N)h.‘ At a 
sufficiently high temperature, the effective relativistic degrees of freedom is given as = 
228.75 in the MSSM. Hereafter, we use ~ 200 as a reference value.® The reheating 
temperature is given by 



^ The PQ symmetry remains broken if y ^ 1. 


® To be precise, we should include the degrees of freedom of hidden fields in g^, which however does not 
affect our main results qualitatively. In Sec. 3.5, many SM particles are decoupled in the thermal plasma 
due to a large VEV of the H^Hd flat direction, so that g, is smaller. 
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In a finite temperature, the following thermal log potential is induced via two-loop effects: [60, 
61] 


Vt(0) — CTa^T^ log 



(19) 


for 0 3> T/gui where au = is the hne-structure constant of SU{N)h and ct (> 0) is 

an 0{1) constant determined by the beta function of SU{N)h coupling. 

The flat direction 0 starts to oscillate at t when the Hubble parameter becomes 

comparable to the soft mass or the curvature of thermal potential. The Hubble parameter 
at the commencement of oscillations of 0 is given by 


hL ^ Max 




72 y^ VTa^rlHMp, 


( 20 ) 


This implies that 0 starts to oscillate around the origin before reheating completes, i.e., 
> Trh- In our scenario, we hnd that is determined by the second term for the 
parameters of our interest. Substituting 0{1) parameters, we obtain a typical value of 
as 


~ 1.4 X 10^ GeV 


-RH 


1013 GeV 


V 

5 X 10“ GeV J ’ 


( 21 ) 


where we have adopted au — 1/25 as a reference value. This implies that ~ 3.3 x 
10i3 GeV for the above reference parameters. 


3.2 Suppression of the axion CDM isocurvature perturbations 

When the flat direction 0 obtains a large VEV as Eq. (15), its F-component is given by 



F3(t)Mpi 

33/2A 


1/2 


5 


( 22 ) 


from Eq. (13). This implies that the SU{N)h gaugino obtains a soft mass via the gauge 
mediated SUSY breaking effect: 


mx 


rs-* 




167r2 (0) 


N' 

16\/37r2 

8 


H{t). 


(23) 


(24) 












We may write the Lagrangian of the SU{N)h gauge field as 


C = 


+ H.C., 


( 26 ) 


where 


i9 


th = 


H 


2g_ 


H 


IhTT^ 


u 2 ’ 

9h 


(26) 


is a chiral spurion superheld that contains the gauge coupling qh, vacuum angle 9h, and 
gaugino mass m\ [62, 63]. The axion appears in the gauge kinetic function, and it can be 
taken into account by the replacement of 


9h ^ 9h — 3Nf — ^ 

Va N fa 


(27) 


where we have used fa = Va/N^m = Val^NNp) in the second equality. 

Next, we calculate the conhnement scale of SU{N)h in order to determine the axion 
mass. First, let us consider the present era, where the VEV of 0 is absent, (0) = 0. In 
this case, the SU{N)h gauge theory contains Np flavors of Q'p and Q'h- For a sufficiently 
large Np, SU{N)h remains weakly coupled at present. Above the soft SUSY breaking scale 
mgusY, the running gauge coupling is given by 

1 1 


3N - NL /msusvA 


(28) 


gliig) 9 h{'^svsy) 

where /r (rngusY < /x < yVa) is the renormalization scale. Next, suppose that the held 0 has 
a large VEV as Eq. (15) in the early Universe. The helds Q'p and Q'p then obtain heavy 
masses due to the nonzero VEV of 0, which modify the running of the gauge coupling (see 
Fig. 1). The SU{N)h conhnes during inhation if the conhnement scale Ah is higher than 
the Hubble parameter during inhation, hfmf. The conhnement scale Ah depends on 0 as 


= det (y'4>) 


(29) 


because the renormalization group equation changes at the energy scale of y'f. For later 
convenience, we dehne Ah by 

(0) ^ det (|/'0) (30) 


where th is given by Eq. (26) with the replacement of Eq. (27). 

At the conhnement scale Ah, the gaugino condensation gives rise to the ehective super¬ 
potential given by [64] 

lUeff = NAlif). (31) 
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Figure 1: Renormalization group flow of the SU{N)h gauge coupling gn- It is weakly coupled 
at present for sufficiently large while it is strongly coupled at the energy scale of Ah{4>) if (j) 
develops a large VEV in the early Universe. 


Therefore, the field a acquires an effective potential such as 


U = 


d'^eWes + H.c. 


327r^ 

9% 


A 3 I 3a 

mxAfj cos ( —- 


+ ..., 


N N^fa, 

where we use Eqs. (22), (30), and (31). This gives the held a an effective mass of 

i^infAi,(0) 


where 


m„(0) = 


f2 
J a 


. (1.0 X 10-GeV)^ X (^5^) 


X 


fa 


5 X 1013 GeV 


-2 




4 X 1013 GeV 


Cm. — 


6^3 Af 


N* 


(32) 

(33) 

(34) 

(35) 

(36) 


When 'n„({|.)>|)j|j,) > is satisfied, the field a does not acquire quantum fluctuations 

during inhation, thus avoiding the isocurvatnre constraint. 
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3.3 Spontaneous baryogenesis via axion dynamics 

Now let us consider the axion dynamics after inflation. We shall show that spontaneous 
baryogenesis by the QCD axion works for certain parameters as one application of the 
strongly broken PQ symmetry. 

We assume that SU{N)h is deconhned just after inflation. This can be achieved if the 
inflaton decays into the SU{N)h gauge held as well as standard model particles and the 
maximum temperature of the Universe (or the hidden sector, if it is decoupled from the 
standard model sector) is larger than the conhment scale Ah'- 


Here, the maximal temperature of the Universe after inhation is given by® 

60 


T ~ 

max — 




I 




~ 2.9 X 10^^ GeV 


/-flinfJWpi 

h/ 


1/4 


0.2 X 10® GeV 


1/4 


H. 


inf 


1011 GeV 


1/4 


(37) 


(38) 

(39) 


We also require the following condition to avoid the restoration of PQ symmetry by thermal 
effects: 


fa > Tmax- (40) 

Now, let us explain the dynamics of the axion and 0 in our scenario. During inhation, the 
axion acquires the ehective mass of Eq. (35), which is assumed to be larger than the Hubble 
parameter to suppress the isocurvature perturbation. After inhation ends, the temperature 
of the Universe soon reaches the maximal temperature T^a v, and then, the axion becomes 
massless because of Tmax > ^^((I^Dinf)- When the temperature decreases to T = ~ 

Ah{4>), the axion again acquires an ehective mass due to instanton ehects of SU{N)h gauge 
theory. As we shall see shortly, the minimum could be diherent from that during inhation, 
in which case the axion starts to oscillate about the new minimum. Here, the minimum of 
the axion potential is given by Onfa, which is determined as 

Oh = 0h,o + arg [det {y (0))] + arg [det (//' (0))] + N arg [mx,o], (41) 

® At such a high temperature, axions can be in the thermal equilibrium via interactions such as g + 5 O 
a + g, where g represents gluon [65, 66 ]. Then the SU{N)h hidden gauge fields are also in the thermal 
equilibrium via similar interactions as gH+gH^CL + gH, where gn represents hidden gluon. Also, if the 
temperature is higher than yva, Qh and Qh are thermalized. Thus SU{N)h is in the thermal equilibrium 
and is deconfined after inflation even if the inflaton decays only into the SM particles. 
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where 9hq is the bare theta parameter and mx^ is the mass of SU{N)h gaugino. Since 
the minimnm of the axion held valne is related to 6fj, it also depends on the phase of 
symmetry breaking term throngh arg[mA,o]- As the symmetry is assnmed 

to be largely broken in the inhaton sector, the phase of 17(l)j?-symmetry breaking term 
generically changes after inhation, which implies that the minimnm of the axion potential 
is shifted by an amonnt of Aa ~ 0{l)fa- Therefore, the axion starts to oscillate aronnd the 
new minimnm at T = ~ Ah{4>)- This axion dynamics breaks the CPT invariance, which 

enables the spontaneons baryogenesis [40, 41, 42, 43, 44], 

Let us focus on the dynamics of axion at the temperature around T = and consider 
the spontaneous baryogenesis based on Ref. [43]. We assume that the axion couples to the 
electroweak SU{2) gauge helds as 


C D 


qI 


327r2 /, 


FF. 


(42) 


where g 2 is the SU{2) gauge coupling. Using the anomaly equation of the SU{2) gauge 
theory, we obtain the following derivative couplings between axion and SM particles: 


C 


Ja 

p J B-\-L ' 

Ja 


(43) 

(44) 


where cf = 1/3 and is the B + L current. Note that this deformation is valid if 

the SU{2)l sphaleron effect is sufficiently efficient [44]. The sphaleron rate is given by 
Tsphaieron ~ 25 02 ^"^ per Unit time and volume [67]. Taking the thermal volume, 1/T^, 
and comparing it to the Hubble rate, the sphaleron decouples above the temperature of 
order 10^^ GeV. This is of the same order with so that our scenario is marginally 
consistent. Note that the above sphaleron decoupling temeprature is calculated by assuming 
0(2 ~ 1/25. Since we introduce some SU(3)c charged fields, such as Qh and Qh, the unified 
gauge coupling constant may be larger than 1/25.^° This implies that the SU{2)l coupling 
constant may also be larger than 1/25 at a high temperature. Therefore, the sphaleron 
decoupling temperature may be higher than 10^^ GeV in our model and we can safely use 
Eq. (44). 

One needs baryon or lepton number violating interactions for successful spontaneous 
baryogenesis. We shall focus on the lepton number violating operator mediated by right- 
handed neutrinos, and so, let us focus on the lepton asymmetry in the following. From 

One needs to add extra matter fields in order to form complete multiplets under 517(5), which would 
keep the gauge coupling unification intact. 


12 





Eq. (44), the axion dynamics leads to an effective chemical potential for lepton asymmetry 
as 


Meff 



(45) 


At the temperatnre of T = the axion starts to oscillate aronnd the minimnm and 
the effective chemical potential is given by pefr — CaH(T^^^)Aa/fa- The nonzero effective 
chemical potential results in the following equilibrium number density: 


eq 

L 


D 


(46) 


Note that the equilibrium number density is realized only if the baryon/lepton number is 
explicitly broken and its rate is sufficiently rapid. 

Now we introduce right-handed neutrinos for the seesaw mechanism [68] and assume 
that their masses are close to 10^^ GeV. Thermal leptogenesis [69] does not work for such 
heavy right-handed neutrinos. Nevertheless, they provide lepton number violating processes, 
ll ^ HH and IH ^ IH, where I and H represent left-handed lepton and higgs multiplets, 
respectively. The effective lepton number violating rate is roughly given by 




(47) 


where fhf is the sum of the left-handed neutrino mass squared and is assumed to be of order 
the atmospheric neutrino mass squared difference, ~ 2.4 x 10“^ eV^ [70]. This lepton 

violating interactions lead to a nonzero lepton asymmetry in the Universe in the presence 
of the chemical potential of Eq. (45). The resulting lepton asymmetry just after T = is 
thus calculated as 


T=7 



(48) 


After the axion starts to oscillate, the generated lepton asymmetry is partially washed 
out due to the inverse processes. This is described by the following Boltzmann equation: [71] 

-^ ~ -VLa^ULit). (49) 

Using Eq. (16) before reheating and gf) after reheating, where g'^ is the 

effective number of degrees of freedom for number density, and matching the solutions at 
T = Trh, we obtain 


a^nL{T -)■ 0) = a?nL{T = T“g^)A^, 


(50) 
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where 


log ~ -0.7 


T, 


RH 


1013 GeV 


(51) 


This implies that the reheating temperature cannot be much larger than 1013 GeV to avoid 
the washout effect due to the inverse processes. 

Since T = occurs before the reheating completes, the baryon asymmetry is calculated 
as 


rib 

s 


Yh = — ~ 


Suf + 4n 


H 


22nf + ISriH 
~ 1.6 X 10"^° A,„ 


T, 


3nj 


RH 


4ptot 

^RH 


RH 


1013 GeV 


7/2 


m 


1.4 X 109 GeV 


-3/4 


(52) 

(53) 


where n/ = 3 and hh = 2 in the MSSM. Here, we implicitly assume that 0 and axion 
oscillations never dominate the Universe, on which we shall comment shortly. We find that 
the observed amount of baryon asymmetry ~ 8.6 x lO^n can be explained by the above 
mechanism. Since and > Trh, there is a lower bound on the 

reheating temperature to explain the observed amount of baryon asymmetry: 


~ 5.0 X 10^2 GeV. 


(54) 


This implies that the conhnement scale Kh during inflation should be higher than 5.0 x 
1012 GeV. 

Our scenario requires the Hubble parameter of inflation to be of order lOH GeV. This is 
because it should be smaller than the mass of the axion during inflation, while the successful 
baryogenesis requires a high reheating temperature. The energy scale of lOH GeV predicts 
the tensor-to-scalar ratio of order r = 0(10“^), which is too small to be detected in the 
future GMB polarization experiments. 

Finally let us study the dynamics of (j) to see if the above scenario works successfully. 
The field 0 starts to oscillate around the origin of the potential at H = where is 
given by Eq. (20). After the held (j) starts to oscillate, Ah{4>) becomes much smaller than 
the temperature of the Universe, so that the axion becomes massless again. So far we have 
assumed that 


r“c > Ut. (55) 

holds so that axion starts to oscillate before 0 starts to oscillate. Otherwise the dynamical 
scale becomes much smaller than temperature before axion starts to oscillate to generate 
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the baryon asymmetry. Here, let us check that the energy density of 0 oscillation never 
dominate that of the Universe. It starts to oscillate around the origin of the potential by 
the thermal log potential aX H = in which case it is known that Q-balls form after the 
oscillation [72, 73, 74, 75, 76, 77]. The energy density of the flat direction is converted to 
that of Q-balls. However, in the case of our interest, a typical charge of Q-balls is so small 
that they completely evaporate via interactions with thermal plasma [78, 79]. Thus, they 
evaporate soon and dissipate into thermal plasma, and their energy density never dominates 
the Universe. 


3.4 Axion dark matter and self-interacting dark radiation 


At T ~ Aqcd, the axion acquires an effective mass through the non-perturbative effect of the 
SU{3)c gauge theory. The minimum of the axion potential induced by the QCD instantons 
is generally different from that by the SU{N)h instantons. Thus, the axion again starts to 
oscillate around its minimum at T ~ Aqcd and we can explain the observed DM abundance 
by the axion oscillations as Eq. (3). 

Let us mention an interesting prediction of our scenario. To solve the strong CP problem, 
the SU{N)h gauge theory should not be conhned at present. Therefore, our model predicts 
that there are at least massless hidden gauge bosons, and some of the hidden quarks Q'jj and 
Q'fj may also remain sufficiently light.Since those light hidden particles are in the thermal 
equilibrium just after inflation ends, they contribute to the energy density of the Universe 
as dark radiation [80, 81, 82, 83]. Their abundance is commonly expressed by the effective 
neutrino number and is calculated as [80] 


AM. = 


^{N^-1) + 2N'^ 


f 

V43/4 


-4/3 


0.093 


- 1 


+ 0.041iVb 


( 9* \ 

V200y 


(56) 

(57) 


where N'p denotes the flavor number of massless (or sufficiently light) hidden quarks. To¬ 
gether with the SM prediction of = 3.046, this is consistent with the present constraint 

of = 2.99 ± 0.39 [84, 85]. The ground-based Stage-VI CMB polarization experiment 

CMB-S4 will measure the effective neutrino number with precisions of AAeg = 0.0156, so 

The SU{N)h can be asymptotic non-free at present if there are many massless hidden quarks. If (p 
develops a small VEV, hidden quarks Q'^j, and Qh acquire a light mass and some of them may be decoupled 
at present. Alternatively, if the [/(l)/j symmetry is broken down to a discrete R symmetry, some of them 
acquire a non-zero mass depending on the //-charge assignment. The scalar components have a mass of order 
msusY and they do not contribute to dark radiation. 
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that it can indirectly test onr model [86, 87]. In addition, the dark radiation (i.e., SU{N)h 
gange boson and hidden qnarks) is self-interacting in onr model [82], and so, it has different 
clustering properties compared to the standard free-streaming one. The clustering proper¬ 
ties are represented by its effective sound speed and its viscosity parameter These 
parameters can be measured by CMB observations [88, 89, 90, 91, 92, 93, 94], so that in prin¬ 
ciple we can distinguish between our model and other models that predicts free-streaming 
dark radiation. 


3.5 Application to the flat direction 

In this subsection, we consider a more economical model in which the SU{N)h gauge sym¬ 
metry and the held 0 are replaced with QCD and the HuH^ hat direction, respectively. In 
this model, we will introduce extra quark multiplets to obtain a sufficiently large dynamical 
scale Aqcd during inhation [25]. We consider a KSVZ-like axion model [56], where the Higgs 
helds do not carry PQ charges. 

Let us consider the H^Hd hat direction with a superpotential of 

1 ^4 




( 68 ) 


where we denote 0^/2 = H^Hd. The hrst term in the RHS is the usual Higgs /i term. This 
superpotential leads to the following potential of the hat direction: 

I ±\^ 


y{4>) =ral\(t)\ -7 




M, 


PI 


(0^ -f c.c.) - CrH'^ 


( anXH-^ 
y AMpi 


c.c. I A 


Mpi 


+ 14(0),(59) 


where (~ /x) is the mass of the hat direction. Hereafter, we assume ch = clh = ^ for 
simplicity. At a hnite temperature, the thermal potential 14 is given as 


14 ( 0 ) — erasT log 


J'2 


(60) 


for 0 S> T/g. The coefficient is given by ct = 9/8 for the HuHd hat direction. Since the 
hat direction has a tachyonic mass of order the Hubble parameter, it obtains the VEV of 
Eq. (15) during inhation and inhaton oscillation dominated era. Then, the hat direction 
starts to oscillate around the origin of the potential at the time of Eq. (20). 

When the H^Hd hat direction has a large VEV during inhation, quark multiplets obtain 
ehective masses much larger than the QCD scale Aqcd- Since the renormalization group 
how of the QCD coupling constant is sensitive to the number of light quark multiplets, the 
dynamical scale of SU{3)c depends on their masses, i.e., the VEV of the hat direction. A 
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large VEV of 0 can make the effective QCD scale during inflation Aq^j^ much larger than 
Aqcd ~ 400 MeV. Therefore, the axion mass can be enhanced in the early Universe, and 
if it is heavier than iifinf during inflation, the axion quantum fluctuations are suppressed. 
However, in order to make the dynamical scale as high as 10^^ GeV, we need to introduce 
extra colored particles. We add Np pairs of Q'p and Q'p, which are charged under SU{5), 
with the following interaction, 

^Q'„ = Q'hQ'h- ( 61 ) 

Note that the extra quarks do not have any PQ charges. In this case, the effective QCD 
scale can be as high as [25] 

^ 1.3 X 10^ GeV , (62) 

for 0 ~ M' ~ Mqut- As a result, the axion mass is given by Eq. (35).^^ If ma > Hmi during 
inflation, the isocurvature constraint can be avoided. 

Next, we consider the scenario of spontaneous baryogenesis. As in the previous subsec¬ 
tions, we assume Umax ^ Aq^j-, so that SU{3)c is deconhned and the axion becomes massless 
just after inflation. Then, when temperature decreases down to Aq^^, the axion again ob¬ 
tains an effective mass due to the non-perturbative effect. Here, the minimum of the axion 
held is determined by the theta parameter and is given by 

Oes = 0o + arg [det {yuyd}] + 3 arg [Mg] - 3 arg [yB] , (63) 

where 6*o is the bare theta parameter and Mg is the mass of SU{3)c gaugino. Since the 
minimum of the axion held value is related to deg, it also depends on the phase of R-symmetry 
breaking term via arg [Mg] . In general, the phase of R-symmetry breaking term changes after 
inhation because the source of R-symmetry changes after inhation. This implies that the 
minimum of the axion held changes after inhation, so that the axion starts to oscillate at 
T = Aqcd- This dynamics can be used to realize the spontaneous baryogenesis. 

In contrast to the previous model, the SU{2) gauge symmetry is spontaneously broken by 
the large VEV of HuHd in the present scenario. This implies that sphalerons are decoupled 
and one cannot use the anomaly equation to derive the lagrangian of Eq. (44). So, let us 
instead introduce a Kahler potential of 

K ~ l(yl + HQ [cnV'*!'+ (64) 

Ja 

In our setup, the up and down quarks may be lighter than Aq^q. In this case, we should replace Ap in 
Eq. (35) to defined by (A^Q^v ^ ^3N-2 mumd, where m„ and is given by yu4> and respectively. 


17 




where A represents the axion superfield and 'ipi represents SM matter superfields. This leads 
to the following derivative couplings between axion and SM particles: 


C 


Ja 

+ • • • • 

Ja 


This leads to an effective chemical potential for the lepton current as 

dpa 

fa ~ fa' 


_ a T 

/^efF / ^ Qi^i „ — C 


(65) 

( 66 ) 


(67) 


where Lj are lepton charges of fields i, and Qi are the numbers of spin states, but with 
an extra factor of 2 for bosons. Thus the axion oscillation can induce a nonzero chemical 
potential for the lepton current. When we introduce a heavy right-handed neutrinos and 
realize the seasaw mechanism, it gives us lepton violating interactions. Note that lepton 
violating processes are efficient via the electron and higgs interactions though the Higgs 
VEV is much larger than the temperature of the Universe. Thus the lepton asymmetry is 
approximately given by Eq. (48). The subsequent calculation and discussion are the same 
with those explained in the psevious section and the final result is given by Eq. (53). 

Some time after inflation, the HuH^ fiat direction starts to oscillate around the origin of 
the potential. Then, the effective QCD scale becomes equal to Aqcd, and the axion becomes 
massless again. Finally, the axion starts to oscillate around the QCD phase transition and 
contributes to CDM. The DM abundance can be explained when the PQ breaking scale 
satisfies Eq. (4). 

Finally, we comment on another source of baryon asymmetry in this model [95, 96]. When 
the fiat direction starts to oscillate at H = Hose, hs phase direction also starts to rotate in 
the complex plane. This implies that the masses of MSSM particles obtain a time-dependent 
phase through the Yukawa interactions. Since the time-dependent phase of mass terms can 
be interpreted as a chemical potential, we obtain the chemical potential of B + L current 
from the dynamics of the H^Hd fiat direction: 


fiB+L — ( 68 ) 

where we define hy (j) = \(f)\ Let us emphasize that the origin of this chemical 

potential is completely different from that considered above. Therefore, the baryon and 
lepton asymmetry may also be generated by the spontaneous baryogenesis via this chemical 
potential. However, the fiat direction starts to oscillate due to the thermal log potential. 
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so that the kick in the phase direction is so small that the rotation frequency is much 
smaller than the Hubble parameter ihosc- This implies that the resuling chemical potential 
is much smaller than that obtained by Eq. (45). Therefore we can neglect this contribution 
and justify our result of Eq. (53). 

4 Conclusions 

The QCD axion is one of the plausible candidates for CDM, which is, however, severely 
constrained by the isocurvature perturbations. In this paper we have proposed an extension 
of the QCD axion model to avoid the isocurvature constraint by suppressing quantum fluc¬ 
tuations of the axion. Specihcally we have considered a scenario where the PQ symmetry is 
badly broken by a larger amount in the past than in the present, due to non-perturbative 
effects of hidden or SU{3)c gauge interactions. Most importantly, the dynamical scale can 
be temporarily enhanced during inflation, if the renormalization group flow of the gauge 
coupling is signihcantly modihed by a flat direction with a large VEV. If the dynamical 
scale is enhanced so as to make the axion mass heavier than or comparable to the Hubble 
parameter during inflation, the axion isocurvature perturbations are suppressed. 

The dynamics of the axion and flat direction could be slightly involved after inflation. 
We have focused on the case in which the maximal temperature of the Universe is higher 
than the dynamical scale so that the axion becomes massless just after inflation. Some time 
after inflation, the axion becomes massive again and starts to oscillate around the potential 
minimum when the temperature becomes comparable to the dynamical scale. Interestingly, 
if the axion has a coupling to SU{2)l gauge helds, the axion oscillation induces a nonzero 
effective chemical potential of the B + L symmetry, which would generate the baryon/lepton 
asymmetry in the presence of baryon/lepton number violating operators. We have shown 
that a correct amount of the baryon asymmetry is generated by the QCD axion via spon¬ 
taneous baryogenesis, by taking account of the AL = 2 process mediated by the heavy 
right-handed Majorana neutrinos. Soon after the baryon asymmetry is generated, the flat 
direction starts to oscillate around the origin of the potential. In the hrst model, the hidden 
gauge interactions then become weakly coupled and it remains so until present. Depend¬ 
ing on the flavor number of the hidden quarks, the hidden gauge interactions may become 
asymptotic non-free. Thus, the axion becomes massless again. Finally, at the QCD phase 
transition, the axion acquires a tiny mass through non-perturbative effect of QCD instan- 
tons and it is stabilized at the CP conserving minimum. The observed DM abundance can 
be explained by the QCD axion produced by the misalignment mechanism. To realize the 
above scenario and account for the observed baryon asymmetry and the DM abundance. 
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the Hubble parameter of inflation must be of order 10^^ GeV. We have also shown that the 
scenario can be similarly realized when the flat direction is identihed with the H^Hd flat 
direction once we introduce additional colored particles at an intermediate scale. 

One of the predictions of our scenario based on the hidden gauge interactions is that 
there must be a self-interacting dark radiation with AWfr = 0(0.01 — 0.1) given by Eq. (57). 
The ground-based Stage-VI CMB polarization experiment will be able to detect the dark 
radiation with this amount and distinguish it from free-streaming dark radiation. 

In the Appendix we also consider an interaction between axion and Ricci scalar, which 
results in a heavy axion mass during inflation. We hnd that the axion abundance as well as 
isocurvature perturbations are suppressed, so that the axion decay constant can be as large 
as the GUT scale. 
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A Model with a coupling to the Ricci scalar 

In this Appendix, we provide another model to suppress the axion isocurvature perturbations. 
We consider a model where the axion is coupled with the Ricci scalar as 

C = cos (^j - 9 , (69) 

where cr and 9r are constants. Since R = —6((a/a)^ + d/a) ~ —12H^ during inhation, 
the axion acquires a mass much larger than the Hubble parameter for cr > /a/Afpi, and 
therefore the quantum huctuations of the axion is suppressed. 

Here we simply assume that there are no other PQ breaking terms; in particular, any 
other Planck-suppressed operators are assumed to be absent or sufficiently suppressed. In 
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general, the absence of such PQ breaking terms is an issue that has been discussed extensively 
in the literature [10, 11, 12, 13, 14, 15, 16]. Our purpose is not to explain the long-standing 
problem concerning the high quality of the PQ symmetry, but to study cosmological impacts 
on such PQ breaking terms that are enhanced in the early Universe. 

The peculiarity of the above interaction (69) is that it suppresses not only the axion 
quantum fluctuations, but also the axion DM abundance. To see this, let us estimate the 
axion abundance. At the time around the QCD phase transition, the energy density of 
the Universe is dominated by radiation, i.e., a oc go that the Ricci scalar is one-loop 
suppressed as [98, 99] 

R = -3{l-3uj)H^ (70) 

162n/2 

for the SU{3)c gauge theory with three flavors. Thus, it induces the so-called Hubble-induced 
term for the axion: 

£ = + , (72) 

Ca ~ 1.6cRas^^, (73) 

Ja 

where we have expanded the axion potential around the potential minimum. Since ~ 1 
at the time around the QCD phase transition, Ca is much larger than unity as long as 
cr ^ fa/Mpi. Then, the axion abundance is expected to be suppressed in a similar way as 
the adiabatic suppression mechanism for the moduli abundance proposed in Ref. [100]. 

In order to estimate axion abundance, let us solve the following approximated equation 
of motion for the axion: 

a + 377a ~ -ml{T)a - clH\t) (a - ORfa ), (74) 

where 77 = l/2t, ma(T) is given by Eq. (2), and we have omitted higher order terms. 
Let us explain the behavior of the axion qualitatively. First, in the regime of 77 S> ma{T), 
the Hubble-induced term dominates the axion potential, so that the axion stays at a ~ 
dufa- Then, at the time around 77 ~ ma(T)/ca, the potential minimum starts to move as 
amin(Q = ^nfaCaH'^/(ml + Here, the typical time scale of the shift of the potential 

minimum amin(Q is of order the inverse of the Hubble parameter, while that of the axion 
oscillations is of order (caH)~^ (^ 77“^). This means that the minimum of the axion 

This is for ease of comparison with Ref. [100]. The axion abundance can be similarly suppressed even 
if one solve the equation of motion without any approximation. 
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potential changes adiabatically, and the axion number density in the comoving volume is the 
adiabatic invariant, and practically no axion oscillations are induced through this dynamics. 
Finally, in the regime of H ^ ma(T)/ca, the Hubble-induced mass becomes negligible and 
the axion oscillates around the present vacuum, and its energy density decreases as a~^. 

We can estimate the abundance of the axion oscillations induced by weak violation of 
the adiabaticity [101]. The resulting axion abundance is roughly given by 

(75) 

V^osc / 

where tosc — Ca/2ma(tosc) for Ca ^ 1. Therefore, the axion-Ricci scalar coupling suppresses 
the axion abundance efficiently. The result shows that, for a certain value of c^, the observed 
DM abudance can be explained even if the axion decay constant is as large as the GUT scale. 

Finally, let us comment on the difference of the present model from the original one in 
Ref. [100], where the moduli mass in the low energy is constant with time. In fact, it was 
pointed out in Refs. [102, 103] that the adiabaticity of the moduli dynamics is necessar¬ 
ily broken by the inflaton dynamics, leading to a non-negligible production of the moduli 
oscillations. This is because, while the inflaton is lighter than the modulus held which ac¬ 
quires a mass of 0(10 — 100)Frinf during inhation, the inhaton eventually becomes heavier 
than the modulus held some time after inhation. When the two masses are comparable, the 
adiabaticity is necessarily broken, which leads to production of some amount of moduli oscil¬ 
lations. In particular, the moduli abundance is only power suppressed and not exponentially 
suppressed. In contrast, the axion abundance is exponentially suppressed in our scenario, 
because the axion mass ma{T) is negligible until the QCD phase transition. In the context 
of moduli problem, our result implies that the adiabatic suppression mechanism works suc¬ 
cessfully and the moduli abundance is exponentially suppressed, if the moduli potential in 
the low energy vanishes during and some time after inhation and arises at a sufficiently late 
time. 
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